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CHAPTER  1 


GENERAL 

1 NTKPUH.T  1 ON 

Satellite  Comrauni  cation  (SATCOM)  systems  currently 
being  developed  for  military  airborne  command  pout  application 
will  bo  required  to  provide  reliable  command  and  control 
communication:;.  1’he  Air  Force  Avionic::  Laboratory  (AFAl  1 ban 
been  involved  in  the  Satellite  Communication  (SATCOM)  Air- 


borne Terminal  development  prop:  ram  since  1 . The  SATCOM 

Terminal  addrer.r.ed  in  thin  investigation  wan  developed  to 
work  with  the  Lincoln  Experimen  tal  Satellite:;  (LRS)  Number:; 

B and  in  the  )(>  to  GIL.’,  extra  high  frequency  (FHE)  baini 
and  the  CCS  to  400  MIL/,  ultra  high  frequency  (UHF)  band. 

The::e  test,  nat.ellit.es,  Figure  1,  are  repreneittati ve  of  the 
t.ypi  that  will  be  part  of  the  world-wide  jam  resistant  com- 
munication:; link  between  the  Airborne  Command  Post,  aircraft 
(F-4)  and  the  force  elements  (bombers  and  missiles)  an 
discussed  in  the  AFSC  News  Review  (12),  the  Aviation  Week  and 
Space  Techno l opy  (11)  and  the  t’lipht  tent,  report  by  Carnes 
Miller  entitled  "SURVSATCOM  (Ka-Band)  Flipht  Lent."  (17). 

The  recently  completed  EHF  and  UHF  SATCOM  Flipht.  Lest 
Program  provided  three  outputs  in  tern;:;  of  system  performance 


analysis,  next  generation  design  update  and  reliab  i t.y  and 


maintainability  (R  M)  model  update.  These  outputs  included; 


l.  data  for  a meaningful  evaluation  of  the  system 


1* 


1 


r 


) 

l i ab  i l i ty 

„ reliability  data  for  the  preparation  of  quanti- 
fiable aspects  for  the  next  generation  dual 
frequency  SATCOM  Sot  development 
).  the  update  of  R/M  model:-,  currently  under  develop- 
ment at.  Mattel  1>  Columbus  laboratories  (BC1  1 as 
discussed  by  ,T.F.  Drennan  and  ,1.1..  Easterday  in 
a technical  memorandum  on  t.  i 1. 1 ed  i "Re  l iab  i l i ty 
Analysis,  of  the  SATCOM  Terminal"  (4). 

At  the  outset  of  the  test,  program,  a requirement 
was.  established  to  as.sess  the  onpo  i np;  system  reliability 
prior  to  proceed  inp.  with  the  planned  follow-on  development 
program  for  advanced  SATCOM  systems. 

OR Phi  KM  STATEMENT 

The  ultimate  output,  of  a system  is  the  performance 
of  some  intended  function.  For  the  Military  Airborne  Command 
Post,  this  can  be  described  as  a reliable  command  and  control 
commits  i oa  t i on  function.  Seine  of  the  major  at.tribut.es  that 
influence  system  performance  p.reatly  are  those  of  reliabili- 
ty, maintainability  and  availability. 

In  this  study,  the  reliability  of  the  Ka-band  and 
UHK  SATCOM  Sets  are  addressed  in  order  to  assess,  in  some 
detail,  their  reliability  characteristics.  In  addition 
consideration  is  p;iven  to  such  questions  ast  (1  ) How  realistic 
is  the  observed  Mean  Time  between  Failures  ( MTbF 1 value  for 
the  groups  under  study  when  compared  to  an  exponential 


V 


4 

ti  i s t r i I'll  t.  i i'M?  ( 1 How  woll  does  the  observed  MTBF  compare  to 
(ho  prod  i o toil? 

ANALYSIS  _L  IMITATION:' 

Tho  analysis  is  limited  to  t.ho  Airhorno  Command  Posit 
Kill*'  and  UHK  equipment  rol 'lability  and  not.  to  tho  likelihood 
that  other  elements  of  tho  SATOPM  system  are  operational. 

Also  tho  analysis  is  not  eoneerned  with  quality  of  the  op- 
erational performance  of  the  various  links,  but  only  with 
tho  rol  iabi  1 i ty  o f these  1 inks. 

MKTHOP  OP  ATTACK 

The  plan  of  attack  in  this  study  includes,  as  des- 
cribed in  subsequent,  chapters  and  appendixes,  a coverage  ot 
research  methods  and  techniques  used,  a test  plan  doserib- 
i up,  data  needed  to  test  the  question  of  the  problem  under 
analysis,  the  source  t*  such  data,  the  techniques  for 
p;a  t her  i np,  and  reduo  inp,  the  data,  and  a description  of  the 
fools  and  techniques  for  ana  ly:*,  inp,  the  data. 

Data  were  gathered  from  the  libraries  at  the  Uni- 
versity of  Dayton,  Air  Force  Institute  of  Techno  1 op,y , the 
Air  Form'  Avionics  Laboratory  (AFAL),  the  U.S.  Army  Materiel 
(Command  Pamphlets  per  fa  in  inp,  to  rel  i ah  i I i ty  requirements! 
personal  libraries  of  personnel  at  AFAL,  and  tho  Department 
of  Defense  Military  Standards  and  desip, n handbooks.  Personal 
interviews  were  conducted  with  maintenance  personnel  concerned 
with  the  KHF  and  UHF  test,  programs,  SATCOM  prop,ram  malfunction 
reports  and  event  lop;s  were  used  to  obtain  failure  data  and 


L 
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time  of  failures.  A description  of  tools  and  techniques  for 
collecting  data  is  covered  in  subsequent  chapters.  This  report 
addresses  a description  of  an  airborne  satellite  communi cation 
(SATCCM)  set  and  includes  a section  that  describes  techniques 
for  analyzing  the  data  collected  and  the  identification  of 
statistical  techniques  and  sources. 

PREVIEW  OF  REPORT  CONTENT 

Chapter  2s  a review  of  the  relevant  literature  con- 
cerning Satellite  Communication  Systems  and  reliability 
briefly  addresses  the  need  for  reliable  communication  systems 
in  the  near  term.  In  the  remainder  of  the  chapter,  the 
importance  of  system  reliability  is  discussed.  In  addition, 
the  latest  system  reliability  analysis  approach  is  discussed. 
Also,  basic  reliability  measurement  and  test  concepts  are 
reviewed  and  applied. 

Chapter  3*  in  this  chapter,  the  Satellite  Communi- 
cation System  (SATCCM)  addressed  in  this  study  is  described. 

In  addition,  the  SATCCM  system  reliability  aspects  are 
discussed  and  SATCCM  system  reliability  models  described. 

Chapter  4:  in  the  data  acquisition  chapter,  a data 
acquisition  approach  is  given  as  part  of  a test  plan.  This 
plan  was  accomplished  with  a minimum  interference  to  the  on- 
going Flight  Test  Programs.  The  remainder  of  this  chapter 
covers  the  approach  taken  for  data  collection  and  reduction. 

Chapter  5»  the  data  analysis  chapter  presents  the 
reliability  data  in  both  tabular  and  bar  graph  format  to 
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enable  the  reader  to  determine  Jus  own  findings.  In  addition, 
an  analysis  is  conducted  with  data  obtained  from  the  Flight 
Test  Program  and  with  system  reliability  estimates  provided 
by  the  contractor,  Pattello  Columbus  Laboratories  (BCL). 

This  results  in  the  finding  that  certain  groups  of  equipment 
within  the  system  under  analysis  experienced  the  most  failures. 
The  reliability  model,  as  given  in  chapter  1,  is  instrumental 
in  determining  which  o.pil  pmont  wottl  1 nee.i  reliability 
improvomen  t. . 

Chapter  0:  in  this  chapter  the  conclusions  and  re- 
commendations for  further  study  are  presented.  These  are 
based  on  analysis  of  the  data  presented  in  previous 
chapters.  In  this  study,  the  Communication  Terminal  Group- 
10  would  appear  to  require  the  most  attention. 
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CHAPTER  2 

REVIEW  OP  RELEVANT  LITERATURE 

SATELLITE  COMMUNICATION  SYSTEMS 

Satellite  communications  (SATCOM)  systems  are  presently 
being  developed  for  military  airborne  command  post  applications 
for  the  direction  of  U.  S.  Forces  located  world-wide.  Satellite 
systems  operating  at  various  r'rh  luenc  ! • -.  arc  1 »>.  • Imr  -,t . i. 

The  requirement  for  a reliable  and  secure  world-wide  communi- 
cation system  exists  using  the  Command  Fost  aircraft.  Because 
of  the  importance  of  communications  for  command  and  control, 
no  single  communication  mode  can  be  depended  upon  to  satisfy 
the  total  communication  requirement.  The  existing  communica- 
tion systems  which  fulfill  those  requirements  include  high 
frequency  (HP),  very  low  frequency  (VLP^,  and  line  of  sight 
relay  of  ultra  high  frequency  (UHF)  and  above.  A new  class  of 
communication  systems  is  now  being  developed  in  order  to  im- 
prove the  communication  reliability  and  to  increase  coverage. 

This  new  class  of  communication  systems  involves  a system 
winch  uses  a line  of  sight  relay  through  a satellite  to  in- 
crease coverage.  An  informative  discussion  of  satellite  com- 
munications is  found  in  a brochure  prepared  by  AFAL,  entitled 
Air  Force  Avionic  Laboratory  SATELLITE  COMMUNICATION  PROJECT  (1 ). 

The  Command  Post  aircraft  (E-4)  is  being  equipped  with 
a super  high  frequency  (SHF)  satellite  communication  system 
which  will  operate  over  the  Defense  Satellite  Communication 
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System  ( DSCS ) - Also  contact  between  the  command  post  and  the 
aircraft's  defense  forces  will  be  provided  by  the  Air  Force 
Satellite  Communication  System  (AFSATCOM),  which  uses  ultra 
high  frequency  (UHF)  band  to  provide  teletype  communication 
between  the  command  and  the  force  elements.  To  increase  com- 
munication survivability  and  reliability,  a new  SATCOM  system 
was  developed  using  the  extra  high  frequency  (EHF)  band.  This 
new  system  will  be  based  on  the  concepts  provided  by  the  Lin- 
coln Laboratory,  which  is  part  of  the  Massachusetts  Institute 
of  Technology. 

The  Air  Force  Avionics  Laboratory  (AFAL)  recently 
completed  a flight  test  program  to  prove  technology  and 
demonstrate  system  feasibility  using  the  Lincoln  Experimental 
Satellite  (IES)  Numbers  8 and  9 operating  in  the  EHF  band. 

In  order  to  use  both  the  EHF  and  SHF  SATCOM  systems  on  the 
E-4,  the  Air  Force  Avionics  Laboratory,  according  to  Allen 
Johnson  in  his  paper  entitled  "Dual  Frequency  Satellite  Com- 
munication System"  1 ■ - developing  a dual  frequency  SATCOM 
system  which  will  allow  operation  in  either  the  SHF  or 
EHF  band. 

SYSTEM  KEL I ABILITY 

Importance  of  Reliability  Fleoi  ionic  systems  are  t la- 
heart.  of  the  satellite  communication  airborne  command  post. 

It  i s not  enough  for  these  systems  to  work  most  of  the  t imo, 
because  nat  lonal  defense  Is  too  cult  leal.  However,  as  stated 
by  Lt  . ilen.  Hryoe  Foe,  1 1 In  Ills  paper  out  It  led  "AFA1  0:  Making. 
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Better  Electronics  Affordable" (19 ) i "In  this  day  of  dimin- 
ishing resources,  we  must  also  add  the  word  'affordable', 
since  increased  performance  is  required  to  match  the  increas- 
ing threat,  balancing  eomi  :•  x 1 ; y , copat  i i'v,  and  :::a  Inta  ! :.at  11- 
i ty  with  reliability  and  cost  is  a great  challenge  for  both 
the  Air  Force  and  the  Electronic  Industry".  Therefore,  in  the 
final  analysis,  cost  of  an  electronic  system  is  tied  directly 
to  reliability  and  maintainability.  Lack  of  either  greatly 
1:  -:*t  costs.  This-  is  what  life  cycle  cost  is  about  --  the 

trade-off  between  the  cost  of  designing  reliability  in  an  af- 
fordable system  now  and  the  increased  cost  of  making  it  work 

later,  as  discussed  by  Dummer  and  Winton  in  their  text  enti-  \f 

tied  "An  Elementary  Guide  to  Reliabili ty" ( 5 ) , 

Complexity  and  Capability  versus  Reliability  The 
ever-growing  needs  of  Mission  Critical  Avionic  Systems  re- 
sults in  equipment  of  ever  increasing  complexity.  As  the 
number  of  components  in  a piece  of  equipment  is  increased, 
the  probability  of  failure  of  that  equipment  is  inci'eased. 

The  technology  necessary  to  advance  capability  does  tend  to 
increase  complexity,  but  it  could  also  increase  reliability. 

However,  improved  capability  does  not  automatically  improve 
reliability.  There  are  trade-offs  which  may  have  to  be  made 
because  resources  are  limited.  A level  of  reliability  less 
than  that  desired  may  have  to  be  accepted  in  order  to  stay 
within  the  state-of-the-art  and,  just  as  restrictive,  budget 
limitations.  Space  and  weight  are  competitive  factors. 
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Reliability  may  have  to  be  sacrificed  to  fit  the  equipment 
into  the  advance  communication  system  at  the  cost  of  increased 
maintainability.  Therefore,  maintainability  of  the  equipment 
must  be  given  continuing  consideration.  Lloyd  and  Lipow 
addressed  the  above  in  some  detail  as  part  of  the  introduction 
to  their  text  entitled  "Reliability!  Management,  Methods,  and 
Mathematics"  (13)* 

Methods  of  Achieving  Reliability  Improvement 

1.  Design . The  reliability  of  any  piece  of  equipment  is 
molded  by  its  design  and  manufacture.  The  result  of  design 
on  reliability  is  to  establish  the  inherent  reliability  of 
the  equipment.  This  level  of  inherent  reliability  cannot  be 
surpassed  without  design  changes.  Reliability  must  be  con- 
sidered when  a demand  exists  for  a new  piece  of  equipment. 

The  best  method  to  achieve  reliability  is  to  buy  the  design 
in  the  initial  procurement  contract.  Shooman,  in  Chapter  6 

of  his  text  entitled  "Probabilistic  Reliability:  An  Engineer- 
ing Approach"  (23)  discusses  the  need  for  a design  to  assure 
reliability  improvement. 

2.  Tes ting . The  Department  of  Defense  requires  reliability 
to  be  stated  in  quantitative  mission-responsive  terms  for  all 
development  programs.  The  reliability  goal  must  be  based  upon 
technically  realistic  requirements  that  can  be  contractually 
specified  and  demonstrated.  The  concept  of  reliability 
revolves  around  the  ability  of  a system  to  perform  its  intended 
function.  The  function  or  mission  of  the  system  must  be  de- 
fined, together  with  the  expected  operational  environment 
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of  the  equipment.  The  reliability  requirement  must  be  ex- 
pressed in  the  contract  in  terms  that  are  attainable  and 
measurable  to  enable  the  requirement  to  be  enforced.  The 
MTBF  (Mean  Time  Between  Failures)  is  the  measurement  used 
here  for  reliability.  Reliability,  as  a function  of  time 
and  conditions,  is  measured  in  terms  of  mean  time  between 
failure  under  specified  conditions.  Testing  provides  in- 
formation that  can  aid  in  the  evaluation  of  the  equipment's 
reliability.  The  amount  of  testing  performed  is  limited 
because*  testing  costs  money.  A testing  program  may,  how- 
ever indicate  a weakness  in  the  equipment  that  would  not 
otherwise  be  discovered  until  the  equipment  is  in  the  op- 
rational  environment.  With  the  information  obtained  from 
testing,  the  engineer  can  evaluate  possible  design  changes 
to  meet  the  required  level  of  reliability.  In  Chapter  4,  of 
the  Army  Materiel  Command  Pamphlet  700-198,  the  needs  for 
positive  test  management  and  planning  are  discussed  (21). 

3.  Modi fi cation.  Another  method  of  improving  reliability  is 
by  means  of  component  improvement  as  discussed  by  Shooman  in 
Chapter  6 (2 3).  A piece  of  equipment  can  be  made  more  re- 
liable by  replacing  the  high  t’ailure  rate  items  with  more 
reliable  parts,  circuits,  or  assemblies.  To  use  a modifi- 
cation program  to  its  best  advantage,  there  must  be  an  in- 
formation system  that  will  indicate  the  part  that  is  failing, 
how  it  failed,  when  it  failed,  and  why  it  failed.  Modification 
is  limited  to  correcting  the  shortcomings  of  design  and 
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and  manufacturing  and  the  effects  of  unforeseen  conditions 
in  the  actual  environment  in  which  the  equipment  is  called 
upon  to  operate.  However,  modification,  at  best,  is  a patch 
or.  the  equipment  and  modification  may  not  be  economically 
justified.  Technology  advances  may  point  to  new  equipment  as 
a better  cost-effectiveness  alternative.  Although  modification 
is  a method  of  increasing  reliability,  it  is  a "find-it,  fix- 
it"  operation.  It  is  used  only  because  the  original  design 
and  manufacture  fell  short  of  the  goal. 

Redundancy . Redundancy  is  another  method  whereby  reli- 
ability of  equipment  may  be  increased.  Redundancy  is  the 
use  of  two  or  more  components,  circuits,  or  items  to  perform 
a function  which  normally  requires  only  one  of  these  circuits, 
components,  or  items.  In  redundancy,  a failure  of  all  duplicate 
items  capable  of  performing  the  function  must  occur  before  the 
failure  to  perform  the  function  exists.  An  advantage  of 
redundancy  is  that  it  may  be  the  quickest  solution  to  a 
reliability  problem  when  time  is  of  prime  importance.  It  may 
even  be  the  cheapest  solution  if  the  components  are  economical 
when  compared  to  the  cost  of  redesign  and  manufacture  of  the 
new  equipment.  The  disadvantages  of  using  redundancy  to  im- 
prove reliability  are  numerous.  For  example,  the  components 
necessary  to  duplicate  the  function  may  be  very  costly.  Added 
circuits  or  components  would  require  added  space  and  weight. 

Iti  addition,  redundant  items  may  attenuate  the  input  signal, 
causing  a need  for  additional  amplifiers,  which  in  turn 
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increases  the  complexity  of  the  equipment.  Prom  an  analysis 
of  the  advantages  and  disadvantages  of  redundancy,  the  great- 


est gain  in  increased  reliability  by  the  use  of  redundancy  will 
be  on  items  that  have  a low  reliability  or  critical  reliability 

as  discussed  by  Von  Alvern  in  his  text  entitled  "Reliability 
Engineering"  (28). 

5.  Derating.  Derating  is  another  method  used  by  design  engi- 
neers to  increase  reliability  in  electronic  equipment.  In  de- 
rating, equipment  designed  for  operation  at  a certain  level  uses 
parts  designed  to  operate  at  a higher  level.  The  main  advantage 
of  derating,  as  discussed  by  Shooman  in  Chapter  6,  is  that  it 
will  tend  to  increase  the  life  expectancy  of  the  equipment  (23). 
However,  derating  tends  to  increase  manufacturing  costs  because 
parts  used  to  derate  may  cost  more  than  the  parts  actually  re- 
quired to  satisfy  design  specifications. 

The  TASRA  Model 

General  The  TASRA  (Tabular  System  Reliability  Analysis) 
model  was  developed  by  BCL  for  performing  reliability  analyses 
of  complex  systems.  It  is  well  suited  for  this  purpose  in 
that  the  model  can  simulate  real-world  situations  in  which  a 
malfunction  occurs  in  the  system  but  major  portions  of  the 
system  remain  operational,  as  well  as  situations  involving  a 
complete  failure  of  the  system.  The  TASRA  model  is  computer- 
based  and  configured  so  that  the  detailed  functional  inter- 
relationships of  the  system  components  are  represented  in  the 
reliability  model.  Thus,  failure  of  a subassembly  or  assembly 


in  the  real  system  will  have  the  sJimo  effect  on  the  system  op- 
eration a:;  the  reliability  model  depicts.  In  a TASh’A  analysis, 
the  term  "malfunction"  means  a sometimes  acceptable  degradation 
in  functional  performance  and  the  term  "failure"  is  used  to 
indicate  complete  cessation  of  functional  perfomanco  of  the 
component  or  assembly.  A detailed  discussion  of  the  TASRA 
model  is  g i von  by  Easterday  and  Drennan  in  the  special  interim 
report  ir.  i ; "Preliminary  Ka-Band  Availability,  Reliability 
and  Maintainability  Es timates" (b ) . 

Overview  of  , p i ■ > • 1 ' ‘ l . • M, it-  1 ! r;  r;  1 rcocdur-  '''he  1 ABBA  u;->-r 
must  generate  a functional  description  of  the  total  system 
and  its  subsystems,  major  assemblies,  subassemblies,  etc.  The 
most  important  evi  terion  in  this  step  is  to  select  "building 
blocks"  such  that  a failure  of  each  is  logically  independent 
of  the  failure  of  the  other  "bu  l 1 d i n.r.-b  l or  k s"  at  that  system 
level.  A diagram  is  prepared  to  document  this  partitioning 
at.  each  level.  This  level-by-level  set  of  partitioned  func- 
tional diagrams  is  one  of  the  basic  inputs  the  analyst  must 
prepare  when  using  the  TASRA  computer  model.  Another  concept 
essential  to  an  understanding  of  the  TASRA  model  is  that  of 
system  states.  The  state  of  the  system  can  bet 

1.  fully  operational,  as  the  specifications  define 
i t, 

2.  failed  (complete  cessation  of  functional  ability) 
called  failure  state,  or 

in  one  of  several  degraded  operating  modes-- 
called  malfunction  states. 


3. 
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The  TASRA  model  can  be  used  to  predict  the  probability  of 
occurrence  of  each  state  defined  for  each  level  of  the  system 
at  which  an  analysis  is  conducted.  This  can  be  expressed  as 
a MTBO  or  mean  time  between  occurrence.  A primary  objective 
of  the  development  of  this  model  has  been  to  orient  it  toward 
the  user.  From  the  user's  viewpoint,  the  performance  of  the 
Ka-Band  SATCOM  terminal  is  measured  by  its  availability  at  the 
time  the  user  needs  to  send  or  receive  a message.  Thus,  the 
message  availability  to  meet  a mission  profile  defines  the 
numbers  of  communications  that  can  be  completed  for  each 
alternative  communication  mode  as  functions  of  mission  time. 

One  specific  measure  employed  is  the  dependability;  that  is, 
the  probability  that  a specified  number  of  communications  will 
be  initiated  and  completed  without  the  occurrence  of  delay 
resulting  from  equipment  malfunction.  A second  measure  of 
terminal  performance  is  "expected  communication  delay",  which 
is  defined  as  the  "best  estimate"  of  the  delay  in  completing 
a communication  that  results  if  the  equipment  malfunctions. 

The  above  overview  was  discussed  by  Easterday  and  Drennan 
in  Reference  6„ 

RELIABILITY  MEASUREMENT 

One  advantage  of  a probabilistic  approach  when  compared 
to  a deterministic  approach  is  the  capability  to  provide  a 
good  measure  of  the  uncertainty  involved  in  a numerical 
analysis,  as  discussed  in  Chapter  2 of  the  Army  Materiel 


Command  Pamphlet  Pamphlet  7O6-I9B  (21),  Another  advantage  is 
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that  a method  is  provided  for  estimating  effects  that  other- 
wise might  be  lost  in  the  random  variation  of  the  data. 

The  designer-engineer  must  solve  a real-world  problem; 
therefore,  the  estimation  of  uncertainty  is  important.  The 
basic  concept  of  statistical  testing,  as  related  to  point 
estimates  and  interval  estimates  during  system  design  and 
development,  are  briefly  discussed  in  the  appendixes. 

The  three  types  of  pariunetric  estimates  most  frequently 
used  are  point  estimates,  interval  estimates,  and  distribution 
estimates.  They  can  In'  defined  as  follows: 

1.  point  estimate  --a  single  valued  estimate  of  a 

reliability  parameter  (Appendix  B).  v* 

2.  interval  estimate  --an  estimate  of  an  interval 
that  is  believed  to  contain  the  true  value  of 
the  parameter  (Appendix  D). 

j.  distribution  estimate  --an  estimate  of  the 
parameter  of  a reliability  distribution 
(Appendix  C). 

Point.  El:  timat.es  --  Appendix  B A point  estimate  of  a 
parameter  is  a single  value  which  is  an  estimate  of  the  para- 
meter. The  most  flexible  estimation  technique  is  the  maximum 
likelihood  estimator  as  discussed  by  Shooman  in  his  Chapter  8 
(2j),  In  Appendix  B,  the  maximum  likelihood  estimator  approach 
is  discussed  in  some  detail.  For  ex;ui\ple,  the  point  estimate 
(MTBF)  for  the  high  voltage  power  supply  at  subgroup  TASRA 
No . )c>2  is  3oJ  hours  based  on  2901  test  hours  and  8 failures. 
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estimates  a re  used  when  it  it;  desired  to  estimate  the  pro- 
bability distribution  governing;  a particular  reliability 
measure.  Phis  involves  a two  step  approach;  i.e., 

1.  the  form  of  the  distribution  must  be  determined 
from  failure  data, 

the  parameter  that  describes  the  distribution 
must  be  estimated. 

To  accomplish  the  above,  the  following  goodness  of  fit 
test  was  selected.  The  Kolmogorov-Smi rnov  (K-S)  test  is  an 
analytic  procedure  for  testing,  goodness  of  fit,  as  discussed 
by  locks  (14),  Miller  and  Freund  (lo),  and  in  the  Army  Materiel 
Command  pamphlet  ','Oo-loh  (Cl).  The  procedure  compares  the 
observed  distribution  with  a completely  specified,  hypothesised 
distribution  and  finds  the  maximum  deviation  between  the  cumu- 
lative distribution  functions,  for  the  two.  This  deviation  is 


then  compared  with  a critical  v 
selected  level  o t statistical  s 
distribution  free,  and  it  can  b 
distribution  that  the  data  are 
random  variable  is  continuous. 
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The  reliability  data  obtained  for  the  Rooftop  Commun- 
ication Terminal  Group-30  were  compared  to  an  exponential  dis- 
tribution using;  the  test  described  in  Appendix  C. 

[n  summary,  with  significance  level  a set  at  .OS  and 
a s:unple  of  Cl  failures,  the  experienced  deviation  was  less 

Thus,  it.  is 


than  the  maximum  deviation. 


seasonal'  1 e to  assume 


that  the  sample  came  from  a population  with  an  exponential  dis- 
tribution* The  results  obtained  are  given  in  Table  lb  of  Ap- 
pendix C. 

Interval  Estimate  --  Appendix  D A confidence  interval 
is  an  interval  estimate  for  which  there  is  a known  probability 
that  the  true  value  of  the  unkr.'wr  parameter  (o.g.,  MTBF)  lies 
within  a computed  interval.  This  estimate  is  more  useful  than 
a point  estimate  because  a much  better  idea  is  given  of  the 
uncertainty  involved  in  the  estimation  process,  as  discussed 
by  Shooman  in  Section  8.10  of  Reference  23.  Again  the  reli- 
ability data  obtained  for  the  Rooftop  Communication  Terminal 
Group- JO  were  used  in  the  calculation  of  an  interval  estimate 
of  MTBF  for  a sampi e of  21  failures  at  a 0.05  significance 
Level,  using  the  procedure  described  in  Appendix  L),  As  an 
example,  the  MTBF  was  calculated  to  be  9').  7 hours  w i th  an 
upper  confidence  limit  of  l45.l)  hours  and  a lower  confi- 
dence limit  of  o2. 


05  hours  for  Group-30, 


CHAPTER  3 


SATCON!  SYSTEM 


SYSTEM  DESCRIPTION 


The  EHF  and  UHF  SATCOM  equipment  designed  for  use  in 
the  LES  8 and  9 satellite  test  program  was  delivered  in  1975* 
One  set  of  EHF  and  UHF  equipment  was  installed  in  a 4930th 
Plight  Test  Wing  C-135  test  aircraft  (tail  No.  662).  A 
simplified  block  diagram  of  the  SATCOM  hardware  is  shown  in 
Figure  2 (1). 

EHF  SATCOM  Set  The  Airborne  SATCOM  Terminal  (ASC-22) 
consists  of  a 1000  watt  millimeter  wave  transmitter,  a 1 ow 
noise  receiving  system,  a steerable  parabolic  antenna,  an 
antenna  pointing  system,  a modulator  and  demodulator  (MODEM), 
and  input  and  output  devices  as  discussed  by  C.  K.  Tsao  in 
his  technical  report  entitled  "Ka-Band  Satellite  Communication 
Set  AN/ ASC-22"  (27),  and  M.  B.  Cappa,  et  al„,  in  the  technical 
report  entitled  "Spread  Spectrum  Modem/Processor"  (3)«  In 
addition  to  the  capability  of  actively  tracking  the  satellite, 
the  SATCOM  system  has  the  capability  of  passive  antenna 
pointing.  An  IBM  n computer,  part  of  the  Computer  Pointing 
System  (0K-227),  is  used  to  compute  the  antenna  pointing 
angle  to  the  satellite  from  stored  satellite  ephemeris 
information  and  aircraft  location/attitude  information 
provided  by  an  inertial  navigation  system  (LTN51).  These 
inputs  allow  the  calculation  of  the  pointing  angles,  the 
range,  and  the  doppler  or  range  rate,  to  the  satellite  as 
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discussed  by  K.J.  Allison,  et  al . , in  the  technical  report 
entitled  "Airborne  SHF  Satellite  Terminal  Test  Program"  (2). 

U HP  SATCOM  Set  The  UHF  SATCOM  system  uses  a UHF 
MODEM  built  by  Linkabit  Corp.  and  reported  by  I.  M.  Jacobs  and 
K.  Gilhousen  in  the  technical  report  entitled  "UHF  AFSAT/SURVAT 
Dual  Modem"  (9).  The  UHF  MODEM  is  physically  located  in  the 
s:tme  rack  as  the  Ka-Band  MODEM.  This  MODEM  interfaces  with  an 
ARC-151  UHF  transceiver.  The  ARC-151  transceiver  provides  a 
100  watt  output  transmit  capability  and  operates  through  an 
omni-directional  UHF  antenna.  The  received  signal  passes 
through  a transmit  receive  switch,  into  a preamplifier,  and 
back  to  the  ARC-151  transceiver  for  down-conversion.  A second 
UHF  SATCOM  system  aboard  the  test  aircraft  used  an  UHF  "DUAL 
MODEM"  system.  The  DUAL  MODEM,  was  designed  to  work  wit})  the 
UHF  modulation  of  LES  8 and  9 or  by  switch  selection  with  UHF 
modulation  of  the  AFSAT  satellite.  In  either  case,  the  modem 
feeds  its  signal  to  an  ARC-1 71  UHF  transceiver,  and  the  100 
watt  signal  is  transmitted  through  an  omni-directional  UHF 
antenna.  The  received  signal  is  routed  through  a transmit 
receive  switch  to  a preamplifier  and  to  the  ARC-171  trans- 
ceiver. 

Roof top- Installation  A complete  complement  of  EHF 
and  UHF  SATCOM  equipment  was  installed  in  AFAL’s  Building  o20 
rooftop  facility,  which  was  specifically  built  to  house  the 
SATCOM  equipment.  A simplified  block  diagram  of  the  equipment 
is  shown  in  Figure  2,  The  EHF  modem,  input  and  output  devices, 
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transmitter  and  receiver,  and  low  noise  amplifier  are  identi- 
cal to  those  described  on  test  aircraft  C-135/bb2.  A 10-ft. 
parabolic  antenna  is  used  in  the  rooftop  facility  in  place  of 
the  aircraft's  3“ft«  antenna.  An  active  tracking  capability 
is  provided  in  the  receiver  and  transmitter  rack.  A computer 
pointing  capability  is  provided  by  a computer  located  in  the 
Communication  System  Evaluation  Laboratory  (CSEL)  facility. 

The  UHF  SATCOM  equipment  in  the  rooftop  facility  is 
identical  to  that  described  in  Aircraft  C-l  )‘j/oo2 , A UHF 
DUAL  MODEM  capability  is  also  available  in  the  rooftop 
facili ty . 

SATCOM  SYSTEM  RELIABILITY 

This  technical  report  discusses  the  operational  re- 
liability aspects  of  the  EHF  UHF  SATCOM  terminals  installed 
in  the  aircraft  and  the  rooftop  test  facilities  as  described 
here.  Each  SATCOM  SET  is  composed  of  subsystem  groups  as 
given  in  block  diagrams  in  Figures  3 through  b.  The  groups, 
consisting  of  identifiable  assemblies,  are  listed  in  Table  1. 
These  assemblies  have  been  assigned  numerical  designations 
in  keeping  with  Tabular  System  Reliability  Analysis  (TASRA) 
designators  established  by  Battelle  Columbus  Laboratories  (BCL) 
for  the  SATCOM  Reliability/Maintainability  (R/M)  model  (4), 
These  designators  are  used  in  the  various  block  diagrams  and 
tables  throughout,  this  report.  The  predicted  MTBF  values  for 
the  SATCOM  SET  subgroup  elements,  as  given  in  Table  1,  were 
provided  by  BCL  as  part  of  the  AFAL's  sponsored  Ka-Band 
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Reliability  Improvement  Program  under  Contract  F33615-75  C-1208. 
These  predictions  are  based  on  the  combined  data  estimates 
furnished  to  BCL  by  the  EHF/UHF  SARCOM  SET  equipment  develop- 
ers based  on  MIL-HDBK-217B  and  by  AFAL  based  on  field  data 
collected  during  the  EHF  SATCOM  SET  test  program  (6)„ 

Theoretical  Estimates  The  theoretical  system  re- 
liability model  predictions  are  based  on  the  equipment 
contractor's  estimated  bottom  level  component  and  module  input 
data.  These  data  "/ere  generated  by  the  manufacturers  using 
the  methods  of  MIL-HDBK-217B  to  estimate  the  failure  rate  of 
electronic  components  and  modules  based  on  the  number  and 
types  of  parts  used,  the  percentage  of  rated  l oad  at  which 
each  part  is  operated,  the  application  of  the  equipment,  etc. 
Although  the  reliability  estimation  methods  of  MIL-HDBK-217B 
are  generally  used  for  military  equipment,  such  estimates  will 
not  detect  inherently  weak  parts  or  conditions  conducive  to 
some  failures,  such  as  parts  that  are  subject  to  unusual  st. rosso 
from  high  transient  voltages  generated  during  switching,  some 
types  of  poor  design  such  as  striving  to  achieve  too  high  a 
gain  in  a single  stage  of  amplification,  improper  interpretation 
of  the  handbook  guidelines,  etc.  These  types  of  failures  will 
often  become  evident  only  during  equipment  operation  and  use. 

Field  Data  Estimates  The  field  data  estimates  are 
calculated  from  field  experience  on  the  existing  SATCOM  SET 
(Appendix  B).  The  Bayesian  method  provided  an  approach  for 
combining  the  reliability  data  obtained  through  experience 


28 

(flight  test)  with  theoretical  est  hint  es . An  example  In  Hi. 
next  paragraph  show s I Ik1  approach  used. 

Comb  i nod  Es  lima  t.os  Brennan,  on  Page  8-3  of  Reference 
o,  discusses  thin  approach  for  determining;  the  combined 
estimates  baaed  on  t.wo  nets  of  data,  the  theoretical  prediction 
and  the  field  experience.  The  procedure  selected  by  BCI,  for 
implementing  a Bayesian  approach  for  adjusting  a predicted 
failure  rate  ( l/MTBF)  with  field  experience  data  includes  the 
assumption  that  10,000  hours  of  test  time  is  added  to  the 
flight  test  time  of  3900  hours.  Knowing  the  predicted  failure 
rate  (X^)  and  the  assumed  operating  test  time  of  10,000  hours 
the  predicted  number  of  failures  can  be  determined.  In  the 
same  manner  the  field  experienced  failure  rate  (X(.)  can  be 
determined  based  on  the  number  of  failures  experienced  and 
number  of  total  operating  hours.  As  an  example,  for  the  sub- 
group TASRA  No.  3b2,  the  combined  estimate  (l/x  ) is  determined. 
X ^ = 1/3955  ~ 2. failures/10,000  hours, 

X . - 1/21 b - 18.1  failures/ ),900  hours, 

X,  (2.‘>3  + 18.1  )/( 1 0,000  + 3,000) 

• 20. 6/13 i 900  c 1 failure/o75  hours 

The  above  is  based  on  the  data  given  in  the  Interim  Special 
Technical  report  prepared  by  BCL  (a).  The  combined  estimates 
(Table  1)  were  used  in  calculating  the  predicted  MTBK  for 
comparison  to  the  observed  MTBF  for  the  EHE  SATC0M  SET.  The 
various  devices  in  the  Input/Output  group,  as  listed  in  Table  1, 
were  used  in  various  combinations  at  various  times  during  each 

test.  Therefore,  a nominal  MTBK  value  of  1000  hours  was 
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TABLE  1 SATCOM  SET  FKED1CTEL)  MTBF  I T EIV  LISTING 


1’ASH  A 

TITLE 

PREDICTED 

Nr . 

MTRF  hrs 

t 

SATCOM  TERMINAL 

35 

2 

SATCOM  SET  (Ka-BAND) 

38 

10 

MODEM- PR OC ESSOR  GROUP 

107 

1 2 

ANTENNA  ALIGNMENT 

1 1980 

1 3 

TOWER  CONTROL  PANEL 

1 58c4 

14 

HOLM  1002  COMPUTER 

981 

1 5 

Ka-BANU  CONTROL  PANEL 

3054 

141  --- 

MESSAGE  PROCESSING  UNITS 

so  c 

180 

SYNCH- DEMUX  UN  I ’l'S 

324 

190 

CODE  GENERATOR 

1°9  3 

195 

FREQ  SYNTH 

1 SOO 

199 

REPORT  BACK  DEMOD 

1 830 

19o  --- 

FORWARD- REFORT  BACK 

17497 

1 98 

CONFERENCE  DECODE 

4482 

192  --- 

MO DU I ATOR 

8374 

1 1 

INPUT-OUTPUT  GROUP 

1000 

115 

TELETYPEWRITER 

1 400 

110 

VOCODER 

2 400 

11? 

CRT- KEYBOARD 

2000 

118 

PAPER  TAPE  READER 

1 000 

119 

LINE  PRINTER 

2000 

20 

COMMUNICATION  CONTROL  GROUP 

1 58 

21 

INERTIAL  NAVIGATION  SYSTEM 

750 

22 

COMMUNICATION  CONTROL  COMPUTER 

100 

23 

INPUT-OUTPUT  DEVICES 

1 000 

30 

COMMUNICATION  TERM  I NAI  GROUP 

129 

311 

POWER  DISTRIBUTION 

271  3 

312 

LOW  VOLTAGE  POWER  SUPPLY 

4197 

321 

LIQUID-AIR  HEAT  EXCHANGER 

1 00000+ 

322 

PUMP-CONTROL  MODUl E 

1939 

32  3 

COOLANT  I 1NES- FITTINGS 

100000+ 

3)1 

RUBIDIUM  STANDARD 

140s 

332 

1 MHz  FREQ  SYNTH 

0 4 37 

333 

STEPP ABLE  FREQ  SYNTH 

24732 

3)4 

FREQ  GENERATOR 

2121 

391 

LOW  NOISE  AM, PI  IF1ER 

1 44  8 

342 

DOWN  CONVERTOR 

4 470 

343 

RECEIVER 

1 00000+ 

)44 

AUTO  TRACK  RECEIVER 

3028 

A 


TABLE  1 SATCOM  SET  PREDICTED  MTBF  ITEM  LISTING 
(Continued ) 


TASRA 

Nr. 

351 

352 

361 

362 

363 

364 

40 

41 

42 

43 

44 

45 

46 

3 

U-  1/0 
50 
60 
70 
60 


TITLE 


DOPPLER  CORRECTOR 
EXC I TER 

RF  MODULE  ( TWT ) 

HIGH  VOLTAGE  POWER  SUPPLY 
TRANSMITTER  LOCAL  CONTROL 
TRANSMITTER  REMOTE  CONTROL 

ANTENNA  CONTROL  GROUP 

ANTENNA  CONTROL  MONITOR 
ANTENNA  PEDESTAL 
ANTENNA  POSITION  CONTROL-POWER 
POLARIZER- DIPLEXER 
PRESSURE  AND  FUME  SENSOR 
RF  WAVEGUIDE  PRESSURE 

SATCOM  SET  (UHF ) 

INPUT- OUTPUT  DEVICES 
ARC -151  TRANSCEIVER 
UHF  MODEM 

ARC- 171  TRANSCEIVER 
DUAI.  MODEM 


PREDICTED 
MTBF  hrs 

2555 

4436 

949 

675 

655 

27005 

808 

2154 

21370 

11840 

2301 

28560 

5831 

517 

2000 

1278 

1476 

1300 

1500 
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assumed  fur  the  Input/ Output  Group. 

SATCOM  SYSTEM  RELIABILITY  MODELS 

The  SATCOM  SET  (E11F  Band)  was  modeled  for  reliability 
prediction  purposes  into  Reliability  Models  A and  B,  but  tin' 
SATCOM  SET  ( If  HE)  was  modeled  as  in  Model  A only. 

Series  Chain  Operation  Model  A,  as  illustrated  in 
Figure  7,  assumes  that  all  terminal  equipment  must  function 
properly  for  a successful  mission.  Model  A is  based  on  the 
approach  that  all  system  elements  are  in  a series  chain  so 
that  any  element  failure  will  result  in  a system  outage.  Also, 
for  the  SATCOM  SET  (UHF)  this  applies  to  either  the  ARC-151  or 
ARC-171  transceiver  with  MODEM  separately.  The  reliability 
model  for  each  of  the  groups  considers  its  respective  sub- 
group element  as  connected  in  series  based  on  component  repair 
or  replacement  as  discussed  in  Appendixes  B and  D.  The 
mathematical  models  used  in  calculating  the  group's  reliability 
are  given  in  Table  2.  Gerald  II.  Sandler  in  his  text  entitled 
"System  Reliability  Engineering"  discusses  reliability  modeling 
concepts  (22). 

Minimum  System  Operation  To  obtain  the  apparent 
reliability  for  the  minimum  system  operation,  the  Model  A as 
shown  in  Figure  7 was  restructured  to  the  Model  B configuration 
shown  in  Figure  8 . This  simplifies  the  computational  Model  to 
a manageable  form.  The  equation  shown  for  the  redundant  ele- 
ments covers  the  case  of  two  parallel,  active  independent 
elements  with  unlike  failure  rates.  To  illustrate,  the  MTBF 
for  this  case  is  derived  below.  It  can  be  shown  that  MTBF  is 
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related  to  the  Reliability  Function  by* 

MTBF  = Jr  ( t ) dt 

For  parallel  elements  the  probability  of  either  or 
both  surviving  is  derived  from  probability  theory  as: 

R(t)  = Ra(t)  + Rb(t)  - Ra(t)Rb(t). 

It  is  assumed  that  the  probability  density  function 
is  an  exponential  distribution  as  discussed  by  Shooman  (23). 


Then 


f(t)  = (i/e  )exp(-(t/e ) ),  t J o,  e ■>  o 


X exp(-Xt), 


x = i/e 


where  the 


Mean  = 0 


Variance  = 0 

and  the  probability  of  no  failures,  R(t),  in  the  interval  (0 
to  t)  is  given  by 

R(t)  = 1 - F(t) 

= exp(-Xt). 

Therefore 

Ra(t)  = exp(-\&t) 

Rb(t)  = exp(-\bt) 

where  X&  and  Xb  are  element  failure  rates, 


MTBF 


= p(-Xat)  + exp(-Xbt)  - exp(  - ( Xa+Xb ) t ) )dt 


(1/xJ  + (l/xh)  - (l/(Xa+Xb)). 


CHAPTER  4 


I 


DATA  ACQUISITION 


TEST  PLAN 

The  reliability  of  the  EHF  SATCOM  set  and  the  UHF 
SATCOM  set  was  evaluated  for  the  entire  flight  test  program. 
Failure  reports  were  obtained  on  all  malfunctions  which 
affected  system  operation.  This  was  accomplished  with  mini- 
mum interference  to  the  ongoing  test  program.  These  reports 
were  tabulated,  and  a determination  was  made  as  to  whether 
the  failure  was  relevant  or  non-rel  evant. . The  failure  re- 
port data  were  tabulated  and  plotted  !:i  term;-  of  the  ot'.-.ervi'd 
monthly  and  cumulative  Mean  Time  to  Failure  values  as  given 
in  Appendix  A. 

The  overal  flight  test  plan  addressed  such  ques 
tions  as i 

1.  how  close  to  theoretical  do  the  UHF  and  EHF 
systems  perform  in  both  a jamming  and  non- 
jamm i ng  environment? 

2.  what  is  the  reliability  and  maintainability 
performance  of  the  aircraft,  and  rooftop  SATCOM 
TERM  l NAL  install  la  tions? 

The  objective  of  the  flight  test  program  was  to  de- 
monstrate the  feasibility  of  an  EHF  airborne  satellite  com- 
munication system  operating  in  a host! o dynamic  jamming 
environment  as  discussed  by  James  Miller  in.  his  flight  test 

lo 
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report  entitledj  "SURSATCOM  (Ka-Band  Flight  Test  Report"  (1?). 
AFAL,  with  the  support  from  other  Department  of  Defense  agencies, 
measured  the  performance  of  the  EHF  and  E'HF  SATCOM  system  under 
various  propagation  and  flight  conditions.  The  results  will 
provide  a base  line  for  future  engineering  development  or  pre- 
production  models  of  the  EHF  SATCOM  system. 

Technical,  reliability,  or  human  engineering  de- 
ficiencies were  recorded  during  the  test  program  and  docu- 
mented so  that  corrective  action  can  be  taken  during  follow- 
on  development  programs.  The  test  plan  included  data  acqui- 
sition and  data  reduction  phases  in  preparation  for  the 
analysis  phase. 

DA  I’ A COt. I. EC  i I ON 

A data  collection  procedure  was  implemented  to  provide 
data  inputs  for  the  following  factors  in  order  to  accomplish 
the  goals  given  in  Chapter  1. 

1.  System  Mean  Time  Between  Occurrence  (MTBO) 

2.  System  Mean  Time  Between  Failures  (MTBF) 

3.  Group  Mean  Time  Between  Occurrence  (MTBO) 

4.  Group  Mean  Time  Between  Failures  (MTBF) 

The  data  acquisition  report  forms  (format  prepared  by 
BCL)  consisted  of  a malfunction  report  and  an  event  log.  A 
SATCOM  system  malfunction  report  contained  spaces  for  group 
level,  major  module  and  submodule  level  information. 

This  included  malfunction  description,  cause  and  corrective 
action,  plus  the  elapsed  time  indicator  readings  and  system 
location.  A SATCOM  system  event  log  contained  time  of  day, 
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elapsed  time  indicator  at  location  and  at  group  level,  plus 
a malfunction  report  number  and  event  remarks. 

The  above  two  data  report  forms  were  used  by  the 
"SATCOM  SET"  field  engineers  and  technicians  in  the  recording 
of  observed  equipment  malfunctions  during  the  test  program 
maintenance  and  repair  at  the  aircraft  and  the  rooftop  test 
1 oca tions . 

DATA  REDUCTION 


The  raw  data  were  reviewed  in  detail  and  transferred 
to  the  SATCOM  system  malfunction  event  analysis  sheet,  which 
provided  space  to  record  a standardized  event  description, 
the  event  effect  on  the  system,  the  event  cause,  the  mainte- 
nance action,  the  maintenance  time  to  repair,  and  notes. 

Space  was  also  provided  for  recording  the  month,  the  assessed 
equipment  identification  number,  the  event  sequence  number, 
and  the  operating  hours  for  each  component  in  the  equipment 
group.  The  event  analysis  sheets,  which  formed  the  basis  for 
the  uata  presented  herein,  were  used  to  cull  out  non-relevant 
failures  from  the  observed  malfunctions. 

In  the  event  analysis  sheets,  each  event  is  classi- 
fied into  one  of  two  event  description  categories  of  equip- 
ment failure  and  equipment  malfunction.  The  first  category 
is  self-explanatory,  and  the  second  category  covers  those 
cases  when  the  equipment  is  not  available  for  inclusion  in 
the  system  operation  configuration  due  to  unresolved  problems. 

The  "event  effect"  classification  addresses  the  loss 
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the  loss 
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of  the  system,  the  partial  loss  of  system,  or  no  loss  to  system. 
These  categories  provided  the  basis  for  evaluating  the  effect, 
of  each  failure  on  system  availability  and  assisted  in  clari- 
fying those  problems  which  are  system  relevant  for  both  the 
aircraft  and  the  rooftop  environments. 

The  "event  cause"  classification  provided  the  fol- 
lowing four  standardized  categories:  module  or  part  failure, 
external  cause  for  intermittent  failure,  unknown  or  unable  to 
varify  failure,  and  the  installation  of  design  modification. 

The  "maintenance  action"  classification  provides 
these  three  following  categories: 

1.  rectify  or  replace  module; 

2.  remove  and  replace  part;  and 

3.  troubleshoot  action; 

which  afforded  a quick  look  at  the  maintenance  action  initiated 
as  a result  of  the  occurrence  of  each  event. 

Information  contained  in  some  of  the  event  analysis 
reports  indicated  that  no  failures  occurred  at  the  element  or 
subgroup  levels.  Therefore,  a statistical  method  was  formu- 
lated to  provide  the  MTBF  estimate  at  a 60 fo  confidence  level. 

The  approach  taken  was  discussed  by  Allison,  et  la.,  in  the 
SHF  Terminal  Test  Report  (2).  This  approach  is  based  on  the 
determination  of  a one  sided  confidence  interval  estimate  for 
a parameter  with  an  exponential  distribution,  assuming  that  the 
tests  are  stopped  after  a certain  number  of  test  hours  have 


been  accumulated. 
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The  formula  for  this  confidence  interval  employs  the  X (p,d) 
(Chi-Square)  distribution  as  discussed  by  Von  Alven  (26),  where 
p is  the  function  of  the  confidence  coefficient  a and  d is 
the  degrees  of  freedom:  For  a one  sided  (lower  limit) 
confidence  level  with  a fixed  total  accumulated  time  period  T 
and  with  no  failures,  r = 0,  the  equation  is 
Q = (2T/X2(a,2r+2),.-^  ). 

For  example,  let  r = 0 at  a confidence  level  of  60% 

2 

resulting  in  X (0,0,2)  approximately  equal  to  0,70?  as  taken 
from  the  X (Chi-Square)  distribution  tables. 

Therefore,  the  lower  limit  MTBF  (0^)  at  r = zero  with 
a confidence  level  of  60%  is 

9l  = 2T/0.70?  = 2.829T. 

Thus, there  is  a 60%  probability  that  the  true  MTBF  is  included 
within  the  lower  limit  of  0^  and  infinity  for  zero  failures. 

This  is  the  basis  for  calculating  MTBF  values  in  Tables  3 
through  8, 

The  reliability  analysis  for  both  systems  Models  A and  B 
and  each  group  provides  two  measures  of  system  performance. 

1,  Mean  Time  Between  Incidents  (Malfunction). 

2,  Mean  Time  Between  Failures  (MTBF). 

Both  of  these  measures  of  system'  performance  are  quantified 
in  Tables  3 through  8 of  Chapter  5 and  the  appropriate  tables 
and  plotted  graphs  in  Appendix  A. 


CHAPTER  5 


A 


DATA  ANALYSIS 


T NTRODUCT ! ON 

The  system  reliability  analysis  was  based  upon  reported 
equipment  malfunctions  from  January  of  1976  to  September  of  1977, 
during  the  ongoing  EHF/UHF  test  program  (7)*  The  data  were 
collected,  tabulated,  and  plotted  from  both  the  aircraft  and 
rooftop  locations  and  included  a total  of  6480  operating  hours 
and  )22  equipment  malfunction  reports.  These  tabulated  and 
plotted  data  are  presented  in  Appendix  A.  Care  must  be  exer- 
cised in  interpreting  the  results  since  these  results  are 
fundamentally  determined  by  the  input  data.  A basic  concern 
throughout  this  analysis  has  been,  "How  realistic  are  the 
available  mean  time  between  failures  (MTBF)  input  data?"  The 
mal functions  that  have  been  experienced  to  date  are  generally 
of  the  type  that  can  be  experienced  in  an  operational  environ- 
ment, such  as  human  error,  random  part  failure,  cabling  pro- 
blems, and  malfunction  induced  by  incorrect  operation  of  the 
ancillary  equipment. 

EVENT  ANALYSIS 

All  events  reported  on  the  Event  Analysis  Sheets  were 
used  in  the  calculation  of  the  Mean  Time  Between  Incidents 
(malfunction)  statistics  as  given  in  the  tabulations  and  plots 
in  Appendix  A.  The  following  guidelines,  described  in  the 
SHF  Satellite  Test  Report,  (2),  were  used  in  determining  which 
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not  detected  aiut  corrected  duo  to  limited 
product  loti; 

n.  unci l la fy  equipment;  and 
t'.  human  enp  l neer  ! ng  factors., 
luce  these  t'aeta'f;;  are  Into  fact  Ive  and  contain  a human 
variable,  a precise  value  cannot  he  readily  determined  for 
the  operational  reliability  of  a system.  An  evaluation  of 
the  expected  degradation  due  to  these  factors  can  usually  be 
made  by  heurlst  Ic  means,  based  upon  pas. t experience  with  like 
equipment  under  similar  Installation  and  operating  condi- 
tions. Using  this,  approach,  it  is  the  opinion  of  the  writer 
a potential  growth  to  a MTBF  of  ('0  hours  appears  realistic, 
but  any  increases  in  MTBF  beyond  this  level  may  be  obtainable 
only  by  the  expenditure  of  considerable  effort.  Also,  design 
improvements  i n the  RF  module-  In  I , high  voltage  power  supply- 
102,  or  SYNCll/DEMUX-lbO  181  could  provide  the  highest  reli- 
ab  l l Lty  payof  f . 

It  should  also  be  noted  that  there  was  no  clear 
d etna  re  at  Ion  between  system  mission  operat  Inc:  l line  and  the 
opera t Inc;  t line  of  the  equipment  devoted  to  checkout  , mainte- 
nance, and  repal'-.  "he  total  operating  time  shown  for  each 
equipment  group  containing  these  add 1 1 Iona  I hours  will  tend 
to  enhance  the  reported  reliability  during  the  Initial  re- 
porting periods..  However,  as  the  total  mission  time  increases., 
these  factors,  will  become  less  and  less-  significant  for  t he 
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T!u'  mal  funct  1 ons  reptrts  did  not  contain  sufflr  ' out 
detail  to  Indicate  s 1 mu  1 1 anoous  failures  of  redundant  ele- 
ment:. whleh  would  oaune  a complete  system  outage,  leading  t o 
the  i‘o  l low  In.!",  two  as:;  ump  t Ions: 

I.  simultaneous  failures  did  not  occur  (observed 
failure  rate).  This  condition  reduces  the 
failure  rate  of  the  redundant  block  to  aero;  and 
simultaneous  failures,  did  occur  lest  1 mated 
failure  rate).  To  simulate  this  condit ion , 
a oO;i.  confidence  level  was  used  to  evaluate 
the  failure  rat  e of  the  Individual  component s 
or  groups  for  which  ero  failure  was  reported. 

I'h  1 s represents  a slat  1:  t leal  anomaly  for  the  groups 
wherein  no  malfunctions  were  reported.  Reference  is  made  to 
discussion  on  Pages  J9  and  40,  and  to  Allison,  et  la.  (2). 

finer  different  operating  t imes  have  been  logged  by 
each  group  In  the  system,  the  enmniat  ive  MThl  imalfnnet ion) 
and  MT1U’’  lactual  failure)  for  the  Model  A system  were  cal- 
culated by  using,  the  mathematical  mode  1 shown  In  figure  i . 

The  MThl''  for  each  of  the  groups  was  calculated  from  the  group 
models  given  III  Table  The  result  1 tig;  system  Model  .1  MThf 

values  are  present  ed  In  Tables  1 t hrough  b.  The  s\.  'tern's 
est  lmat  oil  M'l'ht''  Is  shown  Iti  i’ah  le  1.  The  result  ing.  M .'hi''  value 
for  both  the  observed  (actual)  and  the  estimated  i,i>0  confi- 
dence level)  cases  are  shown  In  fables.  >,  4,  S,  and  n , and 
bar  g.raphs  Iti  Figures  0 through  14.  '.’he  tables  and  plot. 
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presented  in  Appendix  A provided  a breakdown  ol‘  t h<  system 
MTBK  Into  the  individual  groups. 

TOTAL  SYSTEM 

SA1  tOM  erml naJ  - PASRA  N<  . 1 A review  of  Table  3 
and  figure  9 shows  that  each  installation  was  operated  for 
nearly  the  same  number  of  total  hours  and  with  basically  the 
same  type  of  equipment  in  each  local  ion.  The  reliability  at 
the  rooftop  location  is  nearly  twice  t hat  experienced  on  the 
aircraft  location.  In  spite  of  the  two  totally  different 
environments,  degradation  fora  Laboratory  or  operational 
test  system  was  not  as  different  as  anticipated,  because  of 
periodic  equipment  interchanges  for  maintenance  support  pur- 
poses, during  the  flight  test  program. 

SA'IVPM  dot  - TASKA  No.  f A like  comparison  was  made 
for  the  SATCOM  SET  (Ka-Band)  with  the  same  resulting  comments 
is  given  above,  except  for  reliability  of  t lie  antenna  control 
group  reliability.  The  difference  here  was  the  use  of  a 
if-ft . dish  on  the  rooftop  installation  and  a 3-ft.  dish  in 
the  aircraft,  causing  a greater  need  to  debug  the  larger 
i ns t a 1 l at  i on . 

SATCOM  Set  - fASRA  Mo,  3 In  the  SATCOM  Set  (UHP), 
the  equipment  was  generally  operated  in  either  local  Ion; 
however,  a part  ieular  serial  number  single  MOPi-'.M  (rOl  and 
AKC-1M  transceiver  (BO)  were  generally  assigned  to  each 
local  ion. 

prime  Power  - TASK  A No.  H Note  that  in  .’able  3 
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EHF  AND  UHF  SATCOM  TERMINAL  RELIABILITY 
LEFT  BAR-AIRCRAFT 
CENTER  BAR-ESTIMATES 
RIGHT  BAR-ROOFTOP 


Figure  9 

SAT COM  Terminal  Bar  Graph 
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EHF  AND  UMF  SATCOM  TERMINAL.  RELIABILITY 
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and  Figure  9 no  failures  were  recorded.  Therefore,  based  on 
the  total  system  operating  hours  at.  each  location,  the  MTBF 
was  computed  at  the  60%  level.  The  predicted  MTBF  was 
assigned  an  initial  1000  hours,  as  shown  In  Table  1. 

Modem/l'rocessor  Oroup  - TAG  RA  No.  10  Table  9,  with 
Figures  10  and  11,  shows  that  reliability  of  the  signal 
processing  subgroup-16  at  the  aircraft  location  war  slight ly 
less  than  that  estimated,  and  at  the  rooftop  location  it  was 
slightly  more.  The  SYNCH/DEMUX  units-l8o/l8l  experienced  the 
greatest  number  of  failures  resulting  in  an  overall  MODEM, 
Processor  Group-10  MTBF  of  61  hours  for  the  aircraft  location. 
However,  in  the  rooftop  location  these  units-l80/l8l  experienced 
a comparable  number  of  failures  to  that  of  other  subgroups. 

A major  problem  area  with  these  units  was  the  use  of  wire 
wrap  modules  which  in  the  aircraft  location  had  a tendency  to 
experience  shorted  pin  connections  at  the  sub-unit  integrated 
circuit  elements. 

Input/Out  put  Group  - T'AGKA  No. 11  The  input/output 

devices,  which  were  generally  off  the  shelf  itema, experienced 
malfunctions  that  did  not  always  directly  impact  the  system 
reliability,  since  various  modes  of  opera! ion  were  available. 

A nominal  MTBF  of  1000  hours  was  estimated  for  the  input, 
output  group*  with  the  devices,  generally  experiencing  fewer 
failures  on  the  aircraft  than  on  the  rooftop.  Possibly, 
greater*  care  was  given  to  use  of  the  devices  ('ii  the  nl  recall  . 
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stressed  in  the  aircraft  environment,  when  compared  to  the 
rooftop  laboratory  environment,  resulted  in  a larger  number 
of  failures  in  the  aircraft.  The  reliability  data  have  to 
some  degree  been  compromised  by  the  fact  that  some  of  the 
elemental  units  have  been  interchanged  during  the  test  pro- 
gram. 

OBSERVED  MALFUNCTION  TO  RELEVANT  FAILURE  COMPARED 

The  monthly  observed  MTBF  (malfunctions)  and  the 
cumulative  observed  MTBF  (malfunctions),  are  given  as  part  of 
Appendix  A.  Tables  9 through  16  and  Figures  15  through  27  are 
summarized  in  Table  7.  A comparison  was  made  of  the  observed 
malfunction  to  failure  data  with  the  MTBF  calculations  based 
on  relevant  failures  as  shown  in  Table  7-  Note  that  for  the 
EHF  system  under  test  on  the  aircraft,  two-thirds  of  the  150 
malfunctions  were  determined  to  be  relevant  failures,  while  in 
the  rooftop  environment,  71  relevant  failures  to  89  observed 
malfunctions  were  recorded.  This  could  suggest  that  the  air- 
craft environment  places  a greater  stress  of  the  operational 
aspects  of  the  equipment. 

MODELS  A AND  B COMPARISON 

Table  7 shows  that  adding  redundancy  to  the  Communica- 
tion Control  Group  (20/20A)  by  increasing  the  MTBF  from  158 
hours  (predicted)  and  15b  hours  (observed)  for  Model  A to  2423 
hours  and  1460  hours  for  Model  B did  not  greatly  influence  the 
overall  Ka-Band  Set  observed  reliability.  This  was  shown  by 
the  MTBF  value  of  23  hours  for  Model  A and  an  MTBF  value  of 
29  hours  for  Model  B. 
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SUMMARY 

The  cumulative  reliability  data  for  the  EHF  and  UHF 
SATCOM  Set  are  shown  in  Figures  0 through  1^1  for  Model  A. 

The  bar  graphs  allow  a rapid  comparison  of  MTBF  observed  for 
the  aircraft  and  rooftop  data  to  that  of  the  MTBF  predicted 
down  to  the  elemental  level. 

The  data  in  Table  7 were  tabulated  to  provide  the 
final  cumulative  MTBF , counting  relevant  failures  only,  for 
each  of  the  SATCOM  Sets  and  Groups.  In  addition,  the  number 
of  accumulated  malfunctions,  as  given  In  Appendix  A,  is 
compared  to  the  relevant  failures.  Also,  this  table  allows 
for  a rapid  assessment  of  reliability  achieved  during  the 
test  program  versus  that  predicted  for  Models  A and  B. 

L Model  A reliability  data  for  the  EHF  SATCOM  Set  were 

calculated  for  both  the  aircraft,  and  rooftop  locations  based 
on  observed  relevant  failures.  F'or  the  aircraft  location, 
the  reliability  in  terms  of  MTBF  was  S3  hours  and  29  hours 
respectively,  for  a fully  operating  and  minimum  modeled 
system.  This  was  compared  to  the  predicted  KHF  SATCOM  Set  of 
39  hours  and  52  hours  for  the  two  models.  (Tables  7 and  8). 

Adding  redundancy  to  Communication  Control  Group-20 
did  not  significantly  increase  the  reliability  of  the  system. 
To  achieve  any  significant  increase  in  system  reliability, 
more  attention  should  be  given  to  improving  the  Communication 
Terminal  Group-30  and  the  MODEM/Processor  Group-10. 
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TABLE  8 FREDICTED  AND  FINAL  OBSERVED  RELIABILITY  FOR 

THE  Ka-BAND  SYSTEM  SUBGROUF  AND  GROUP  ELEMENTS 


TITLE 

PREDICTED 

AIRCRAFT 

ROOFTOF 

MTBF'S? 

MTBF* 

MTBF-*- 

MODEM-FROCESSOR  GROUF 

107 

61 

147 

ANTENNA  ALIGNMENT 

11981 

2208 

8645# 

POWER  CONTROL  PANEL 

15664 

1104 

8645# 

ROLM  1602  COMPUTER 

981 

441 

764 

MODEM.  CONTROL  PANEL 

3054 

368 

1528 

MESSAGE  PROCESSING  UNITS 

506 

2207 

8645# 

SYNCH- DEMUX  UNITS 

324 

184 

764 

CODE  GENERATOR 

1993 

2207 

8645# 

FREQ  SYNTH 

1500 

1104 

8645# 

RUBIDIUM  STANDARD 

1405 

2207 

3056 

REPORT  BACK  DEMOD 

1830 

1104 

1019 

FOREWARD- REPORT  BACK 

17497 

1104 

3056 

CONFERENCE  DECODE 

5582 

2207 

1019 

MODULATOR 

8374 

6244# 

3056 

INPUT-OUTPUT  GROUP 

1000 

595 

327 

COMMUNICATION  CONTROL  GROUP 

MODEL  "A" 

158 

156 

— 

MODEL  "B" 

2423 

1460 

— 

ANTENNA  CONTROL  GROUP 

MODEL  "A" 

808 

616 

389 

MODEL  "B" 

868 

976 

SATC OM  SET  (Ka-BAND) 

MODEL  "A" 

39 

23 

42 

MODEL  "B" 

52 

29 

— 

+ FINAL  CUMULATIVE  MTBF  BASED  ON  RELEVANT  FAILURES 
# CALCULATED  AT  60%  CONFIDENCE  LEVEL 
4>  COMBINED  MTBF  ESTIMATES  PER  BCL 


TABLE  8 PREDICTED  AND  FINAL  OBSERVED  RELIABILITY  FOR 

THE  Ka-BAND  SYSTEM  SUBGROUF  AND  GROUP  ELEMENTS 
(Continued ) 


TITLE 

PREDICTED 

MTBF4> 

AIRCRAFT 

MTBF+ 

ROOFTOF 

MTBF+ 

COMMUNICATION  TERMINAL  GROUP 

MODEL  "A" 

129 

65 

86 

MODEL  "B" 

135 

69 

— 

POWER  DISTRIBUTION 

2713 

2901 

3385 

LOW  VOLTAGE  POWER  SUPPLY 

4196 

8207# 

3385 

LIQUID-AIR  HEAT  EXCHANGERl OOOOO 

2901 

1128 

PUMP-CONTROL  MODULE 

1939 

1451 

1128 

COOLANT  LINE-FITTINGS 

100000 

8207# 

1693 

RUBIDIUM  STANDARD 

1405 

725 

9576# 

1 MHz  FREQ  SYNTH 

6537 

8207# 

9576# 

STEPPABLE  FREQ  SYNTH 

24732 

8207# 

9576# 

FREQ  GENERATOR 

6524 

8207# 

1128 

LOW  NOISE  AMPLIFIER 

1548 

1451 

677 

DOWN  CONVERTOR 

4570 

1451 

9576# 

RECEIVER 

100000 

1451 

1693 

AUTO  TRACK  RECEIVER 

3028 

2901 

9576# 

DOFPLER  CORRECTOR 

2555 

1451 

3385 

EXCITER 

4436 

967 

1128 

RF  MODULE  ( TWT ) 

949 

363 

484 

HIGH  VOLTAGE  POWER  SUPPLY 

6 75 

•36-3 

1693 

TRANSMITTER  LOCAL  CONTROL 

855 

434 

846 

TRANSMITTER  REMOTE  CONTROL27065 

8207# 

9576# 

r 


b S 

A major  thrust  of  this  program  was  to  assess  the  KHK 
.SATCOM  Pet  reliability.  The  data  collected  for  the  UHF  PATCOM 
bet  were  supplemental  to  the  extent  of  assessing  the  reliability 
for  the  MOP KM  and  transceiver  level  only  for  both  the  aircraft 
and  rooftop  locations. 

During  the  test  program,  a number  of  potential  design 
problems  were  identified  by  the  large  number  of  failures 
experienced  at  specific  elemental  levels.  Primarily,  these 
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CONCLUSIONS  AND  RECOMMENDATIONS 

The  results  of  the  assessment  conducted  in  this 
study  obviously  indicated  that  the  EHF  SATCOM  Set,  which 
is  highly  complex,  can  be  expected  to  have  a relatively  high 
incidence  of  malfunction.  It  appears,  however,  that  potential 
reliability  growth  to  an  MTBF  of  approximately  60  hours  may  be 
obtained.  This  is  based  on  findings  from  the  analysis  of  the 
data  obtained  from  flight  test  malfunction  reports  discussed 
in  Chapter  five.  Growth  beyond  this  level  will  require  con- 
siderable reliability  improvement  for  the  two  groups,  the  EHF 
communication  terminal  and  the  MODEM,  which  are  currently 
experiencing  most  of  the  failures. 

To  reach  an  MTBF  of  100  hours  or  more,  extensive  re- 
design of  the  RF  terminal  would  probably  be  required  to  avoid 
using  redundancy  extensively  as  a main  reliability  improve- 
ment approach,  an  approach  which  can  be  costly  from  a weight 
and  volume  point  of  view. 

Recommendations  for  further  consideration  include 
a reliability  improvement  program  which  addresses  the  use 
of  printed  circuits  in  place  of  wire  wrap  in  the  MODEM/ 
Processor  Group  and  the  redesign  of  the  high  power  amplifier 
and  power  supply  in  the  Communication  Terminal  Group. 
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As  discussed  In  the  review  of  relevant  literature, 
Chapter  0,  reliability  Is  most  easily  obtained  when  it  is 
built  into  the  equipment,  not  added  on  later  by  a modifica- 
tion after  too  many  failures.  Reliability  requirements  should 
be  compatible  with  costs,  schedules,  and  performance,  and  should 
be  based  upon  an  operational  analysis  of  the  system  to  insure 
that  the  system  Is  optimised  with  respect  to  its  proposed 
mission.  There  are  several  ways  of  increasing;  the  reliability 
of  the  equipment: 

1 o a definite  level  of  reliability  may  be  bought 
in  the  original  contract  for  the  equipment, 
including  a testing  program; 

2.  the  equipment  may  be  modified  to  increase 
the  reliability; 

3.  redundant  circuits  and/or  components  may  be 
used  to  increased  reliability;  and 

4.  derating  of  parts  may  be  used  for  greater 
reliability. 

Of  these  methods,  the  preferred  method  is  to  buy  a reliable 
design  and  the  necessary  testing  to  prove  the  reliability  of 
the  design  in  the  original  contract.  Thus,  costly  actions 
to  provide  reliability  are  prevented  after  the  equipment 
is  in  the  field. 
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APPEND  I X A 


TABULATED  AND  PLOTTED  OBSERVED  MONTHLY  AND  CUMULATIVE 

RELIABILITY  DATA 

The  tabulations  in  Tables  9 through  16  and  the 
plotted  data  in  Figures  15  through  27  are  presented  here  to 
provide  backup  data  for  Tables  3 through  8 and  to  cover  the 
observed  malfunction  failure  and  the  operating  hours  pre- 
sented in  the  body  of  this  technical  report. 

The  malfunction  data  observed  either  on  the  aircraft 
or  rooftop  were  presented  in  Model  A only.  The  malfunction 
event  analysis  sheets  were  obtained  for  each  group  and  were 
reduced  to  the  tabulated  data  of  Tables  9 through  it.  These 
groups  for  the  aircraft  and  rooftop  locations  are  listed 
below.  The  malfunction  event  analysis  sheets  were  re- 
evaluated and  hard  core  failures  were  identified  and 
tabulated  in  Tables  3 through  S (7)- 
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Figure  22 
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SUBuKOUr  MThK  hXri'x’TATLONf  BA:'KP  ON  OOMPONIOO'.' 

KKPAIK  ON  RF.l’LAFKMKNT 

A subgroup,  I’ASNA  Nr.  for  example,  is  put  on 

tout  .it  time  t and  operated  until  failure  occurs  at  time  t,. 
f ; on  failure  It  la  aaaumed  that  the  group  component  la  In- 
■ t .tut  l.v  repaired  or  replaced  on  teat  where  It  oont  Inuea  to 
opera'  e uni  1 l l'a  1 lure  oeoura  at  t l me  t This  procedure  la 
aaaumed  to  be  repeated  until  the  elape.o  of  a total  t ea-t  time 
1'.  It  la  furt  her  aaaumed  that  the  t Imea  between  fallurea  are 
exponent  la  1 ly  dlatrlbuted  with  a true  mean  time  between 
fallurea,  MTBF , reprooenl ed  by  0 . The  observed  mean  t 1 me 
between  failure  la  given  by  ? , where  0 la  ootnput  ed  a a.  followa 
0 =*  '1’  K, 

where  T la.  the  total  lead  time  and  K la  the  number  of  fallurea 
which  ooourred  during  that  teat  t lute.  The  derival  Ion  given 
In  the  following  paragraph  ahowa  that  ? la  the  maximum  llke- 
1 1 hood  ead  lmat  or  of  0 . 

based  on  the  assumption  of  the  exponential  d 1 ad  r 1 - 
but  loti  with  mean  A,  It  follows  that  the  probability  density 
that  the  first  failure  occurs  at  t l me  i ( l a 
f | a l l 0)  cxpf-tt  | - 1 q ) . 0) . 

Following  repair  or  replacement,  the  probability  density  that 
the  next  failure  occurs  at  t line  t , la 
f , = (l  0 ) exp  1-  ( t ,-t  | ' 0)  . 

bo 

k i i 


-■■'lit 


and  similar  expressions  hold  1'or  t tie  remaining  failures. 

After  the  Kth  failure  has  occurred.  It  Is  assumed  tint  t tie  sub- 
group operates  successfully  until  the  complet Ion  of  the  test 
at  time  t.  The  probability  of  the  event  Is  given  by 
fK+1  = exp ( - ( t-t  R )/0 ) . 

The  likelihood  function  L Is  then  piven  by  the 
product  of  these  expressions 


and  the  substitution  yields 
L = (1/0 )Kexp(-T/0 ) 

wtiere 

T = t-t 
i 1 o 

The  maximum  likelihood  estimate  of  0 Is  t hen  obtained  by 
finding  t Hat  value  of  0 that  maximizes  L,  Observing  that  L 
takes  on  a maximum  when  In  L is  maximized,  this  value  Is 
found  by  d l fferent 1 at  1 on  of  the  logarithm  of  the  likelihood 
funct ion 

In  [ = -K(ln  0)  - (T/e). 

Differentiation  then  yields 

d ( In  L ) /do  = (-K/0 ) + (T/0J), 
and  by  equating  this  expression  to  zero  it  follows  that. 

0 = T/K 

is  the  maximum  likelihood  estimator  of  0 as  discussed  by 
Spradlin,  Hanks  and  Easterday  (24).  The  maximum  likelihood 
estimator  (MLE)  according  to  Shooman  is  a flexible  and 
powerful  tool.  The  MLE  is  superior  to  the  moment  estimator 
and  the  least  squares  estimator  (23). 


The  NILE  has  a number  of  good  properties.  This  estimator  pro- 


vides a sufficient  point  estimator  If  a sufficient  -u'.t  lmator 

exists  for  the  problem.  Also  the  NILE  is  the  most  efficient 
for  a large  sample  size.  Shooman  in  the  preceding  section  of 
his  text  discusses  interval  estimates  (confidence  coefficient) 
as  addressed  in  Appendix  D.  This  gives  the  analyst  some  idea 
of  how  precise  the  point  estimate  is.  MLE  is  clearly  the  first 
choice,  since  it  is  the  only  estimator  which  allows  a simple 
computation  of  variance. 

The  above  forms  the  basis  for  the  calculation  of  the 
MTBF  values  as  shown  in  the  body  of  the  report.  For  example, 
in  Table  6,  at  the  subgroup  level  the  aircraft  data  for  the 
High  Voltage  Power  Supply  (TASRA  Nr.  362)  had  accumulated 
2901  test  hours  and  a total  of  8 failures.  Thus  the  estimated 
MTBF  based  on  the  observed  data  is  2901  divided  by  8 or  363 
hours.  The  calculations  of  MTBF  at  group  and  system  levels 
are  based  on  the  models  given  in  Table  2 and  Figures  7 and  8. 
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MTBF  dOODNESS  OK  FIT  TEST  FOR  A C.ROUP 
SUBJECT  TO  RETATR  OR  REPLACEMENT 


K M_M  OC,  ROY  - . • MTR  NOV  ONE  CAM  FI  ,E  ’ ’.TV-  T 

Lt  was  Initially  assumed  that  the  probability  den- 
sity of  the  electronic  component  within  the  group  follows  an 
exponential  distribution.  If  this  is  true,  then  reliability 


where 


R = exp  (-T/0) 


T = time  in  hours 


O = MTBF  in  hours. 


By  using  the  MTBF  of  9f> - 7 hours,  data  were  generated  for  a 
theoretical  exponential  distribution  based  on  cumulative 


failure 


F IT)  =1-  exp (-T/0 ) 


This  was  done  to  examine  the  probability  of  a sample  being 
drawn  from  an  exponential  distribution.  To  test  this  theo- 
retical distribution  against  the  observed  distribution  of 
t lie  sample,  the  Kolmogrov-Smirnov  One  Sample  Test  was  used 
as  discussed  by  Locks(l4)  and  Miller  and  Freund  (lb). 

F (T)  = theoretical  distribution  under  the  null 
hypothesis,  11^.  For  any  value  of  T,  time  In  hours  each  in- 
terval, the  value  of  F;  (T)  is  proportional  to  the  number  of 
failures  that  will  have  occurred  before  time  T.  In  Table  is, 


C is  F t ( T ) and  B is  T . 

• (T)  = A/N,  where  A is  number  of  observed  failures 

occurring  before  time  T and  N is  tiie  total  number  of  failures 
observed.  In  '.’able  18,  C is  S (T)  and  B is  T. 

H,  = the  null  hypothesis  that  t;  're  is  m signifi- 
cant difference  between  the  observed  sample  distribution  for 
the  group  of  components  under  test  and  the  theoretical  a- 
:•  nential  iistribution.  If  this  is  1 1 1 u . then  it  is  reason- 
able to  assume  that  the  observed  sample  distribution  is 
approximately  an  exponential.  If  the  sample  wer<  irawn  from 


a population  with  an  exponential  distribution,  it  is  expected 

that  for  every  value  of  (T)t  S (T)  should  be  fairly  close  t( 

F,(T).  The  largest  value  of  F^CT)  - S (T)  is  t lie  maximum 

deviation  of  D . In  Table  18,  D is  the  difference  of  V.  (T) 
m t 

and  S^CT).  The  above  procedure  is  discussed  by  Locke,  in 
his  book  on  page  90,  section  titled  "Goodness  of  Fit  Analysis" 


Critical  value  of  E>  is  determined  by  the  sire  of  the 

sample  and  the  number  of  failures.  Bee  Table  17  (reference 

15  ) for  the  Devalue.  The  level  of  significance  was  set  at 

5% . If  any  D value  of  the  test  exceeds  the  D value  of  2° I- , 

which  is  the  critical  value  of  P for  a sample  of  21  failures 

m 

at  0.05  level  of  significance,  the  null  hypothesis  will 
be  rejected.  If  Hq  Is  rejected,  then  it  would  not  be  rea- 
sonable to  assume  that  the  distribution  of  the  population  is 


'xponent  ial . 


of  Fit  Test 


Table  1"  Critical  Values  for  Goodness 

AMCT  70*  200 


TABLE  14  2 

CRITICAL  VALUES  OF  THE  KOLMOGOROV  SMIRNOFF  TEST  STATISTIC 
N - um^li  jilt.  C • ico  level.  S - i %-9nit,car>c*  level 


A 

C - 80! 

90! 

952 

98! 

991 

S - 20! 

10X 

51 

22 

12 

T 

.900 

.950 

.975 

"990 

.995 

2 

.684 

.776 

.842 

.900 

.929 

3 

.565 

.636 

.708 

.735 

.829 

4 

.493 

.565 

.624 

.689 

.734 

5 

.447 

.509 

.563 

.627 

.669 

4 

.410 

.468 

.519 

.577 

.617 

7 

.381 

.436 

.483 

.538 

.576 

• 

.358 

.410 

.454 

.507 

.542 

* 

.339 

.387 

.430 

.480 

.513 

10 

.323 

.369 

.409 

.457 

.489 

11 

.308 

.352 

.391 

.437 

.468 

12 

.296 

.338 

.375 

.419 

.449 

» 

.285 

.325 

.361 

.404 

.432 

14 

.275 

.314 

.349 

.390 

.418 

15 

.266 

.304 

.338 

.377 

.404 

It 

.258 

.295 

.327 

.366 

.392 

17 

.250 

.286 

.318 

.355 

.38* 

18 

.244 

.279 

.309 

.346 

.371 

19 

.237 

.271 

.301 

.337 

.361 

20 

.232 

.265 

.294 

.329 

.352 

22 

.221 

.253 

.281 

.S14 

.337 

24 

.212 

.242 

.269 

.301 

.323 

26 

.204 

.233 

.259 

.290 

.311 

28 

.197 

.225 

.250 

.279 

.300 

30 

.190 

.218 

.242 

.270 

.290 

32 

.184 

.211 

.234 

.262 

.281 

34 

.179 

.205 

.227 

.254 

.273 

36 

.174 

.199 

.221 

.247 

.265 

38 

.170 

.194 

.215 

.241 

.258 

40 

.165 

.189 

.210 

.235 

.252 

Approxlutlon 

1.07 

1.22 

1.36 

1.52 

1.63 

for  H » 10 

AhTi 

/m+\ 

»M+t 

/JJ+i 

How 

(ll  THe  poc*o  «<■"»**'•  formula  hm  error  traa  then  ahou t • ?>  ol  tfia  *CM»I  value 

(2)  T>H  K-S  it  % >T>p«r*<j  to  |K*  fu#l  - ^<*fKoot»'iev%1  ,or  •"  PO*"*  I*  t*e  *-$  it  no 

more  then  Urns*  the  h*pothe*.*  It  accepted  et  t*e  appopMtte  t<o*v«lence  T^e  TaWe  th*  2 vdeJ  itettic. 

U)  The  K -S  tta*  itt  <c  can  a'ao  be  v«d  to  put  e i <oni>oerve  bend  found  a hypoihaetfed  Cd*. 


Table  18  Goodness  of  Fit  Test  RT-30  Communication  Term 
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Table  19  Program  Coding  (Continued) 


LOC 

CODE 

KEY 

COMMENTS 

TTO 

42 

STO 

21 

21 

42 

STO 

23 

23 

76 

lbl 

11 

A 

44 

SUM 

22 

22 

91 

r/s 

76 

lbl 

01 

12 

B 

42 

STO 

24 

24 

91 

R/S 

76 

lbl 

13 

C 

43 

RCL 

23 

23 

35 

1/x 

94 

V- 

02 

65 

X 

43 

RCL 

24 

24 

95 

= 

22 

INV 

23 

lnx 

75 

- 

01 

1 

95 

= 

94 

V- 

03 

65 

X 

01 

1 

00 

0 

00 

0 

95 

= 

42 

STO 

25 

25 

*Ft(T) 

91 

R/S 

76 

lbl 

18 

C’ 

04 

43 

RCL 

22 

22 

i\ 

RCL 

21 

21 

LOC 

CODt 

KEY 

COMMENTS 

D4' 

95 

= 

65 

X 

01 

1 

00 

0 

00 

0 

05 

95 

42 

STO 

26 

26 

«sn(t) 

91 

R/S 

76 

lbl 

14 

D 

43 

RCL 

25 

25 

75 

- 

43 

RCL 

06 

26 

26 

95 

= 

91 

R/S 

% V 

76 

lbl 

10 

E’ 

43 

RCL 

24 

24 

23 

lnx 

42 

STO 

10 

10 

X(T) 

07 

91 

r/s 

76 

lbl 

19 

D’ 

53 

( 

53 

( 

43 

RCL 

26 

26 

75 

- 

71 

SBR 

08 

l\ 

x^ 

STO 

11 

11 

Y(T) 

91 

R/S 

76 

lbl 

15 

E 

43 

RCL 

10 

10 

32 

X2;  t 

43 

RCL 

11 

11 
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A = numb  or  of  fa  l larva  oaoh  lntorv.il, 
b = T , t I mo  1 n hou ra , 

- % V{  (T)  , 


1. 


c 

" % VT)’ 

D 

K’ 

= (Ft(T)  - Sn(T)), 

= (X),  ( 1 n ( T - XQ)) 

IV 

= (Y),  (In ( -In  (1  - S 

n ( T ) ) ) ) 

A’ 

= Lower  limit  of  (Y), 

<P»  " Y) 

B’ 

= upper  limit  of  (Y), 

(Pm  " Y) 

E 

= computed  statistic 

BUM 

After  the 

st at ist  ic  BUM,  as  given 

in  Table  1 8 , has 

been 

put ed  for 

!■:,  when  i reaches 

ten,  the  slope  js 

and 

intercept 

Y can  he  coniput  ed 

using  program  of 

Tab]. 

'"'or  l hi;',  example,  the  V intercept  is  -S.Sb  with  X of  sere 
and  a slope  f of 

Initially  an  exponential  distribution  with  time  (T) 
for  each  failure  was  derived  by  assuming  a constant  failure 
rate,  X=l/0,  as  discussed  in  Appendix  B.  The  reliability 
R(T),  the  probability  that  the  failure  occurs  after  (T)  is 
R(T)  = exp  (-XT) , T > 0. 

By  taking  the  natural  logarithm  of  the  reliability  function 
H(T)  t ht'  equation 

-In  R(T)  = XT 

can  be  plotted  as  a straight  line  on  sem i -logar 1 t hm  paper 
wit  h an  intercept  at  the  origin  and  a slope  of  \ as  discussed 
by  Locks  (14). 

To  obtain  a straight  line  Weibull  distribution  with 
a parameter  0 and  location  paramet.es  X ^ , define  ?=  1 \ and 
subtract  a Quantity  x which  is  greater  or  equal  to  sere, 


from  O’);  the  resulting  equation  la  a reliability  function 

HO’)  = exp  -(T-X0)/0)S, 

Taking  the  natural  logarithm  of  the  reliability  function 
results  in 

-In  R(T)  = ((T-X0)/0)P. 

The  natural  logarithm  of  the  above  then  results  In  a 
straight  line  reiat  lonshlp  on  lnln  versus  In  graph  paper. 
There  fore 

ln(-lnR(T) ) = g In  (T  - XQ)  - In  0 
and  Is  related  to  the  straight  line 

V = X + 0 

where 1 n 

V = In  v-ln  R(T) , 

X = In  (T  - XQ), 

G = f Ln(0) 

with  g as  the  slope  of  the  line,  and  G as  the  V Intercept  a 
X of  aero.  This  approach  was  taken  in  Figure  28  to  augment 
the  findings  under  the  K-S  One  Sample  Test.  These  equation; 
were  programmed , Table  Id,  on  the  TT-58  programmable  calcu- 
lator and  resuLted  in  the  capability  to  use  linear  graph 
paper  (27).  Figure  .'8,  the  K-S  Goodness  Fit  Test  for  the 
HT-jO  Conunun  l cat  ion  Group,  shows  that  with  the  data  plotted 
from  Table  18,  the  observed  data,  ‘SSn  (T),  with  slope  of 
1.23  is  well  within  the  upper  and  lower  bounds  of  IV  and  A’ 

A’  and  B’  are  based  on  the  1'  critical  values  determined  in 

111 

K-S  one  sample  test. 


% Cumulative  Failures  lnln( 


A1TEND1X  D 


MTBF  AND  CONFIDENCE  INTERVAL  ESTIMATES 
FOR  A SERIES  SYSTEM 

The  successful  operation  of  a series  system  requires 
the  successful  operation  of  each  subsystem  or  group,  conse- 
quently the  probability  that  the  system  operates  successfully 
In  a time  period  (0,  T)  is  given  as  a reliability  function 


R(T)  = exp(-X.T)  exp (- A 0T)  ...  exp(-LT) 

J-  I 1 

where  the  failure  rates  X.  are  equal  to  1/0,  ...  1/0 

l 1 n 


Thus 


ana 


X..  = X,  + Xn  + 


+ X. 


HIT)  = exp  (-X..T) 

o 

MTBF  ESTIMATE S 

Suppose  that  a series  system  consists  of  n systems 
or  groups  Sq , 1=1,  2,  ...n.  Suppose  further  that  subsystem 
Sq  has  been  tested  for  Tj  hours  and  Nj  failures  have  occurred 
during  that  time.  Each  time  a failure  occurs  it  is  assumed 
that  the  subsystem  or  group  is  instantly  repaired  or  re- 
placed in  operation.  It  is  also  assumed  that  the  t line  be- 
tween failures  is  exponentially  distributed,  with  0j  denoting 
MTBF  for  group  i.  Under  these  assumptions  esl imates  of  MTBF 
for  each  group  are  obtained  from  the  test  results  as  shown. 

0.=  'iyNj  , 1 = 1,  2 , ...n 
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,v\  •;  ; N".’i-'SV_A] timattm 

In  sect  l,  n 5.11  of  Koference  .?t),  VonAlven  present  s 
two  situations  for  est  I mat  I no.  a confidence  Interval  for  an 
nxponont  in  1 distribution.  One  ait  nation  in  when  the  toot 
In-  run  until  a proa  a si  {-■'.nod  number  of  failures  occur  and  the 
other  situation  ia  when  the  test  is  stopped  after  a number 
of  test  hours  have  boon  accumulated.  The  formula  for  the 


confidence  interval,  as  discussed  by  VonAlvorn.  employs 


the  V vclil  square)  distribution.  The  general  notation  used 
is  V (p,  d)  wherein  p In-  a fund  ion  of  the  confidence  co- 
efficient and  d Is  the  degrees  of  freedom  as  a function  of  the 


106 


number  of  failures.  Thus,  the  following  Chi-Square  formulas 
were  used  to  estimate  the  confidence  intervals  for  the 
parameters  of  an  exponential  distribution  in  which  the 
failures  were  repaired  or  replaced. 

A U = 2N  0Vx‘  (a/2)  , upper  limit 

9,  = 2N  F/X2  (1  - (a/2))  , lower  limit 

where 

N = Number  of  failures, 

DF  = Degrees  of  Freedom  = 2N 

and 

a = 0.05,  significance  level  for  a 95%  confidence 
interval.  A formula  on  Table  6-2  of  Reference  (18),  titled 
"Percentiles  of  the  Chi-Square  Distribution",  gives  a good 

p 

approximation  for  X (p,  d)  in  terms  of  the  standard  nor- 
mal variate  Z.  Therefore  for  the  upper  limit 

X2(a/2)  = DF ( 1 - -gfppj  - Z ( gfgpy  )V 
and  for  the  lower  limit 

X2(l  - (a/2))  = DF ( 1 - + Z(  ) V 

Let  Z = 1.97,  the  Z value  for  two  sided  symmetrical  upper 
and  lower  confidence  limits.  A program,  Table  20,  was 
formulated  for  the  TI-58  programmable  calculator  based  on 
the  above  formulas  (2  6). 


ble  20  Confidence  Interval  Proerar.  Coding  for  the 


AMI •!,!■:  fRORl.RM 

Given:  The  Ka-Band  Communication  Terminal  (H'J'-jO) 
located  on  the  rooftop  experienced  21  failures  after  2010 
hours  of  test  time  elapsed.  The  problem  is  to  estimate  Un- 
mean  life  0 and  the  two-sided  symmetrical  upper  and  lower 
confidence  limits  on  the  mean  life  with  a confidence  inter- 
val of  95# - 


Steps : 


1.  Tabulate  the  test  results,  T = 2010  hours  and  N = 21 
fa ilures . 

2.  Compute  the  estimated  MTBK , 7)  = 95-7  hour. 

3.  Calculate  the  symmetrical  confidence  level,  C = 95#- 


C ' = 97 • 5%  and  1-C  = 2.5#i  therefore  Z = 1.97  taken  from  a 
normal  distribution  function  table. 

4.  Calculate  the  upper  and  lower  confidence  limits  for  the 
95#  confidence  level,  using  the  TT-58  program.  Enter  STO- 
04  = 1.97  for  the  Z value,  enter  A = 21  and  B = 95-7.  Key 
initiates  the  program.  The  computed  values  are  D = 15^-7  f 
the  upper  limit  and  E = 65. 1 for  the  lower  limit. 

5-  Make  the  confidence  statement  that 
15Jl . 7 > 0 > 65.1 


c 


or 


Thus  there  is  a 95#  probability  that  the  true  MTBF  (0)  is 
included  within  the  above  upper  and  lower  limits. 

Calculations  for  Groups  AC-10,  RT-10,  AC-30,  RT-30, 
AC-40,  and  RT-40  are  listed  in  Table  21.  Tables  10  and  15 


in  Appendix  A contain  the  data  used  in  these  calculations. 


1 10 

Table  21  Group  MTBF  Interval  Estimate  for  a 95ft 
Confidence  Level 


Group 

AC-10 

RT-10 

AC- 30 

RT-30 

AC- 

40 

RT-40 

S TO- O'l 

7=1. 

97  for  a 

two  sided 

95ft 

confidence 

i nter 

% 

A 

1)6. 

23. 

52. 

37. 

7 

• 

9 . 

B 

118.2 

132.9 

65.8 

90.9 

4l4 

.4 

376.1 

C 

Start 

Calculation 

D 

65.8 

209.7 

88.1 

130.5 

10  34 

.4 

824 . 2 

1 

E 

36.7 

91.8 

51.1 

68.2 

222 

. 1 

214.7 

The  greater  the  number  of  failures  observed  over  a 
known  period  of  time,  the  less  the  uncertainty  experienced 

as  shown  by  the  above  findings. 
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